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ABSTRACT 

This study aims to review studies on virtual learning environments in Turkey through the 
content analysis method. 63 studies consisting of thesis, articles and proceedings published 
in Turkish and English between 1996-2014 years were analyzed. It was observed that 
"Second Life" was mostly preferred as the virtual learning environment. Literature review 
and quantitative research methods were mostly preferred in the studies respectively. Most 
of these studies used surveys to collect the data and sample size in most studies was 
between 31-100 participants. Mostly, participants were undergraduate students, and 
purposive and convenience sampling method were preferred in the studies. The data was 
mostly analyzed using quantitative descriptive analysis method. The most studied variable 
was academic achievement and the least one was the cognitive load. The studies yielded 
varying results owning to their study purposes and showed that virtual learning 
environments fostered student academic success, diminished the cognitive load by 
concretizing the concepts and ensured social and collaborative learning. The findings of 
this study might guide researchers aiming to employ virtual learning environments in their 
educational studies. 

Keywords: Virtual learning environments, research trends, content analysis. 

INTRODUCTION 

Education involves a process of changing behaviors through teaching intended behaviors 
to the individuals. Teaching and learning processes help this intended progress gain. People 
intentionally convey their knowledge to next generations. Schools and other educational 
environments are organized to achieve this learning process. From this point of view, 
learning is driven by the influence and support of these specially organized environments. 
The structure of learning environments has undergone various transformations by varying 
educational paradigms to date. The constructivist approach has also changed individuals' 
roles and learning environments. Today, people learn in collaborative environments under 
the guidance of teachers (Murugaiah, Atan, Samsudin, & Idrus, 2004); however, 
permanence of learning is still a major problem. Considering that more efficient learning 
environments would yield more permanent learning, new learning environments are 
structured in line with varying approaches and evolving technological trends. 

Evolving technology has induced variations in technologies employed in educational 
settings over the time. Thus, computer and Internet technologies have been incorporated 
into educational settings as electronic information sources. Development of computer and 
Web 2.0 Internet technologies have led to the birth of a new educational environments. 
This new educational setting was called "virtual learning" or "virtual learning 
environment". 
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Indeed, virtual learning environments were launched with learning machines in 60s and 
appeared as an extension of computer-aided learning tools in 70s and 80s (Atici, 2007). In 
particular, Web 2.0 technologies varied and enhanced the usability of virtual environments. 
Virtual learning environments are described as electronic environments capable of 
providing any kind of interaction between instructors and students including online 
learning (Berry, 2005). Atici (2007) defined the virtual learning environment as an 
educational environment that uses computer and Internet technology supporting students' 
learning process and experiences. 

The constructivist approach shifting the status of students as passive receivers to an active 
participant role in learning environments has been used since 90s (Jonassen, 1999; 
Marshall, 1996; Wilson, 1996). In the constructivist approach, students learn the target 
subject by experiencing, discussing, discovering and deducing as much as possible. The 
environments should be dynamic and interactive allowing new ideas to realize functions of 
the constructivist approach in the learning environments (Roussou, 2004), which is today 
supported in virtual learning environments. Researchers conduct various studies to identify 
whether virtual learning environments meet these needs, and they examine their effects in 
student's performance. Finally, this study aims to analyze and discuss studies on virtual 
learning environments in Turkey and seeks to answers to the following questions: 

1) What are the virtual learning environments preferred in the studies and how have 
they evolved over the years? 

2) In the studies on virtual learning environments; 

a) What were research methods employed? 

b) What were data collection tools employed? 

3) Regarding the sampling of virtual learning environments; 

a) What were the sample sizes employed? 

b) What were the sampling status employed? 

c) What were the sampling methods employed? 

4) What were the data analysis methods employed? 

5) What were the variables addressed by these studies? 

6) What were the outcomes of these studies? 

METHOD 

In the study, content analysis method one of the qualitative research methods was used to 
analyze the studies on virtual learning environments in Turkey. Content analysis is a textual 
analyses of a set of data that typically involves comparing, contrasting, and categorizing to 
classify the data, and to divide it by different identified themes and concepts (Bauer, 2003; 
Fraenkel & Wallen, 2000). According to Tavsancil and Aslan (2001), content analysis is a 
scientific research approach allowing the objective and systematic examination of verbal, 
written and other materials. Content analysis is a method used to analyze the studies in a 
particular field and reach at conclusions based on the findings (Buyukozturk et al., 2012). 

Sample of the Study 

The sample of this study consists of the articles, proceedings and thesis conducted till the 
end of the 2014 in Turkey. The sample population of the study is constituted of databases 
accessible to the Suleyman Demirel University's Information Centre, the Google Scholar 
and the thesis database of the Council of Higher Education of Turkey. 

Data Collection Process 

Review and selection criteria were established to determine the studies to be analyzed in 
the study. In the study, the keywords "virtual learning" and "virtual learning environment" 
were used both in Turkish and in English into the SDU's Information Centre, the Google 
Scholar and the thesis database of the Council of Higher Education to search studies. 
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Following the search, a total of 32 articles in 24 different journals, and 13 proceedings in 
six different conferences were found on virtual learning environments. 16 master thesis 
and two Ph.D. thesis were found on virtual learning environments in the Council of Higher 
Education's national thesis database. Finally, 63 studies carried out in Turkey between the 
years 1996-2014 were reached and analyzed in the scope of the study. Distributions of 
place and year of the studies are presented in Appendix-A. 

Studies addressing the concept of teaching in virtual learning environments were chosen 
for the analyses. Data obtained from the studies were recorded in the "Publication 
Classification Form for Virtual Learning Environment" (Appendix-B) developed by authors 
utilizing the "Publication Classification Form" (Sozbilir, Kutu, & Yasar, 2012) and the "The 
Educational Technology Publication Classification Form" (Goktas et al., 2012). 

Data Analysis 

During the content analysis process, one faculty member and one MA student worked 
together. In the process of analysis and interpretation of studies; the stages of naming, 
developing category, ensuring validity and reliability, calculating frequencies and 
interpretation were carefully fulfilled. In order to achieve validity and reliability studies 
were analyzed on the basis of researchers' agreement. Initial disagreements during the 
content analysis process were discussed and resolved, and then the rest of the studies were 
analyzed by collaborative work between the authors. Finally, the data were organized 
according to the research questions. The data obtained from the content analysis were 
analyzed by means of the descriptive statistics (percentage, frequency, etc.). The results 
were organized, classified and presented in tables and charts, and findings were 
interpreted. 

FINDINGS 

The results revealed that the first study on virtual learning environments in Turkey was 
published in 1996. Therefore, articles, proceedings and theses published between 1996 and 
2014 were analyzed in this study. Number of studies analyzed within the scope of the 
research is 63. Majority of the studies were published in Turkish (f=51) and a small amount 
of the studies were published in English (f=12). Literature review studies and only 
development of virtual environment studies were not included in the content analysis. 

Virtual Learning Environments Selected in the Studies 

The analysis of the studies revealed that mostly preferred virtual environments were 
"Second Life" and "Active Worlds". It was further observed that "Opensim", "Quest 
Atlantis", "Fuvle", "Cubix Editor", "Celestia", "Stellarium" and "Solar Model" represented 
other virtual environments in the studies. Also, virtual learning environments for 
educational practice were developed in some studies (Kosaner, 2007; Tuzun & Ozdinc, 
2010). The analysis revealed that the researchers did not utilize virtual learning 
environments in their studies before 2005. It was observed that the studies till 2005 were 
mostly literature reviews to create theoretical base for the field. Table 1 shows that studies 
on virtual learning environments display a progressive increase over the recent years. 
Although 63 studies were reviewed, only 43 studies were analyzed because some studies 
were used literature review method. Table 1 shows 51 virtual environments because some 
of the studies had more than one virtual learning environments. 
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Table: 1 

Distribution of the preferred virtual environments by year 


Virtual Environment 

2005 

2006 

2007 

2008 

2009 

2010 

2011 

2012 

2013 

2014 

Total 

Second Life 




1 

1 


5 

7 

1 

3 

18 

Active Worlds 





1 

3 





4 

Moodle 





1 


1 


2 


4 

Opensim 








1 

1 


2 

Celestia 









2 


2 

Stellarium 









2 


2 

Solar Model 









2 


2 

Web Quest 




1 






1 

2 

VLE Development 



1 



1 





2 

Quest Atlantis 


1 









1 

Fuvle 



1 








1 

Cubix Editor 








1 



1 

X3D 

1 










1 

True Vision 3D 







1 




1 

Groove Virtual Office 



1 








1 

EFL/ESL 







1 




1 

Other LMS 





1 



2 

3 


6 

Total 

1 

1 

2 

2 

4 

4 

8 

12 

13 

4 

51 


Research Methods and Data Collection Tools 

Figure 1 shows the distribution of research methods in the studies on virtual learning 
environments by the publication year. It was observed that the literature review method 
was mostly used in the studies and then quantitative, qualitative and mixed studies were 
used respectively. It was further observed that the literature review method was used in 
20 studies, the quantitative research method was used in 16 studies, the qualitative 
research method was used in 16 studies and the mixed research method was used in 10 
studies. Furthermore, virtual learning environments were developed in two studies 
(Kosaner, 2007; Tuzun & Ozdinc, 2010). 



Figure: 1 

Distribution of methodologies used in the studies by year 
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Data collection tools used in the studies on virtual learning environments are presented in 
Figure 2. As the data collection tool, "Scales" (35.41%), "Interviews" (18.75%), 
"Questionnaires" (17.71%), "Observations" (11.46%), "Achievement Tests" (8.33%) and 
"Diaries (4.17%)" were used in the studies. In addition, other data collection instruments 
(1.04%) were used such as "Cognitive Load Measurement", "Word Measurement", "Eye 
Tracking" and "Portfolio". Also, it was found that data collection tools were used only in 41 
studies. Figure 2 shows 96 tools as some of the studies used a few types of data collection 
tools in the same study. 



Figure: 2 

Distribution of the data collection tools 


Table 2 shows detailed distributions for data collection tools of the studies. In majority of 
the studies, it was seen that scales (f=38) were preferred as the data collection tool. Thus, 
the most preferred type of scale were likert-type (f=35). Questionnaires (f=19) and 
interviews (f=18) used more often compared to the others. The results showed that Likert- 
type questionnaires (f=13) were preferred more than open-ended (f=3) and multiple- 
choice questionnaires (f=3). Semi-structured interviews (f=13) were found to be the most 
common tool used in the interview studies. Furthermore, it was seen that the observation 
tools (f=ll) and the achievement tests (f=7) were other data collection instruments used 
in the studies. The fNIR cognitive load measuring device, word count and recording device 
and portfolios were used as the alternative data collection tools. Although Figure 2 shows 
a total of 96 data collection tools in the studies, detailed distributions for data collection 
tools reveal 97 tools because one of the studies included both multiple-choice questions 
and Likert-type questions. 
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Table: 2 

Detailed distribution of the data collection tools 


Detailed distribution of the data collection tools 

f 

% 

Observation 

Semi-structured 

9 

9.3 


Other 

2 

2.1 

Interview 

Structured 

1 

1.0 


Semi-structured 

13 

13.4 


Other 

4 

4.1 

Achievement test 

Multiple-Choice 

7 

7.2 

Scale 

Multiple-Choice 

3 

3.1 


Likert-type 

35 

36.1 

Questionnaire 

Open-ended 

3 

3.1 


Multiple-Choice 

3 

3.1 


Likert-type 

13 

13.4 

Alternative tools 

Performance identifier 

2 

2.1 


Portfolio 

1 

1.0 


Data resources 

1 

1.0 

Total 


97 

100 


Sample Sizes, Sample Education Levels and Sample Selection Methods 

Table 3 shows the distribution of the 41 studies with sample details. It is seen that the 

most preferred sampling ranges are "31-100" "0-30", "101-300" and "301 and above" 

respectively. 


Table: 3 

Distribution of the sample size 


Sample size 

f 

% 

0-30 

15 

36.6 

31-100 

19 

46.4 

101-300 

6 

14.6 

301 + 

1 

2.4 

Total 

41 

100 


The distribution of the education levels preferred in 40 studies are given in Table 4. As seen 
in Table 4, mostly undergraduate students (70%) were chosen as sample groups in the 
studies. However, primary and high school students and post-graduate students were 
preferred least often as sample groups. 


Table: 4 

Distribution of sample level 


Sample education level 

f 

% 

Primary School 

6 

15 

High School 

3 

7.5 

Undergraduate 

28 

70 

Postgraduate 

3 

7.5 

Total 

40 

100 


In the study, 42 studies with sampling method details were analyzed and details are given 
in Table 5. The most common sample selection methods were the purposive (52.4%) and 
convenience (42.8%) sampling. However, random sampling (4.8%) were preferred least 
often as sample selection method in the studies. 
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Table: 5 

Distribution of the sample selection methods 


Sample selection methods 

f 

% 

Purposive 

22 

52.4 

Convenience 

18 

42.8 

Random 

2 

4.8 

Total 

42 

100 


Data Analysis Methods 

44 studies that provide information on the data analysis method were analyzed. Table 6 
shows the distribution of the data analysis methods. Qualitative data analysis method 
(37.7%) was the most common data analysis method. Besides the qualitative data analysis 
method, quantitative descriptive (32.8%) and quantitative inferential (29.5%) data 
analysis methods were also used in the studies. Although 44 studies included data analysis 
methods, the total number of data analysis methods in Table 6 is 61 because some of the 
studies used data analysis methods more than one. 

Table: 6 

Distribution of the data analysis methods 


Data analysis method 

f 

% 

Qualitative 

23 

37.7 

Quantitative Descriptive 

20 

32.8 

Quantitative Inferential 

18 

29.5 

Total 

61 

100 


Table 7 shows the detailed distribution of the data analysis methods. The quantitative 
inferential analysis method (f=25) was the most common data analysis method and ANOVA 
(f=7) was the most preferred analysis technique among quantitative inferential data 
analysis methods. The qualitative content analysis (f=16) method was preferred more than 
the qualitative descriptive analysis (f=7) method. It was also seen that quantitative 
descriptive data analysis method (f=18) was used less than quantitative inferential and 
qualitative analysis methods. It was further observed that means and standard deviations 
(f=14) were used more than the frequencies/percentages/tables (f=4) in quantitative 
descriptive analyses. 


Table: 7 

Detailed distributions of the data analysis methods 


Detailed distributions of the data analysis methods 

f 

% 

Quantitative Descriptive 

Frequency/Percentage/Table 

4 

6.2 


Mean/Standard Deviation 

14 

21.5 

Quantitative Inferential 

Correlation 

4 

6.2 


t- test 

5 

7.7 


ANOVA 

7 

10.8 


ANCOVA 

5 

7.7 


MANOVA 

1 

1.5 


Factor Analyses 

1 

1.5 


Non-parametric 

2 

3.1 

Qualitative 

Content analysis 

16 

24.6 


Descriptive Analyses 

7 

9.2 

Total 


65 

100 
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Variable Types Explored in the Studies 

In the study, 40 studies examining the influence of virtual environments on one or more 
variables for educational purposes were investigated. Table 8 shows the distribution of the 
variables studied in the studies. The most common studied variable was usability (27.5%) 
than academic achievement, skill development, motivation, presence, attitude, efficacy, 
cognitive load and spatial thinking variables respectively. 

Table: 8 

Types of variables 


Variables 

f 

% 

Usability 

14 

27.5 

Academic achievement 

9 

17.6 

Skill development 

8 

15.7 

Motivation 

7 

13.7 

Presence 

5 

9.8 

Attitude 

4 

7.8 

Efficacy 

2 

3.9 

Cognitive load 

1 

2.0 

Spatial thinking 

1 

2.0 

Total 

51 

100 


Results of the Studies Conducted in Virtual Learning Environments 

The studies showed that usability of the virtual learning environments are important to 
employ these environments for educational purposes. It was also indicated that virtual 
learning environments did not significantly have influence on academic success in some 
studies (Aslan, 2012; Esgin, Pamukcu, & Ergul, 2012) while other studies had positive 
significant influence on academic success. It was further concluded that the other variables 
addressed in the studies such as skill development, motivation, presence, attitude and 
efficacy were generally influenced significantly in virtual learning environments. Also, it 
was observed in one study learning and teaching processes in virtual learning 
environments generally decreased the cognitive load levels of participants (Cansiz, 2012). 
In addition, experimental studies showed that it was needed less time for activities in 
virtual learning environments compared to other learning environments (Sengel & Ozden, 
2010 ). 

DISCUSSION AND CONCLUSION 

In this study, the studies conducted on virtual learning environments in Turkey were 
explored through the content analysis method. When the literature was considered, two 
content analysis studies were found about virtual environments (Kim, Lee, & Thomas, 
2012; Tokel & Karatas, 2014). The outcomes of these global studies are consistent with the 
outcomes of studies in Turkey. Second Life appears as the most preferred virtual 
environment used in the studies in Turkey. Similarly, Second Life appears as the most 
common virtual environment in the world (Kim et al., 2012; Tokel & Karatas, 2014). In 
addition, consistent with the worldwide studies. Active Worlds, Opensim, Celestia, 
Stellarium, and Solar Model are used as the common virtual environments respectively. 
Furthermore, it was observed that specific virtual environments were developed in some 
studies conducted in Turkey (Kosaner, 2007; Tuzun & Ozdinc, 2010). 

The literature shows that the studies on virtual learning environments around the world 
has increased obviously starting from 2008 (Kim et al., 2012; Tokel & Karatas, 2014). In 
Turkey, a significant increase in the number of studies on virtual learning environments has 
been observed since 2011. Studies both in Turkey and worldwide are generally literature 
reviews. Also, the analysis of the studies on virtual learning environments shows that 
number of quantitative and qualitative researches is close to each other in Turkey. While 
some of the studies reveal that quantitative and qualitative research methods are employed 
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at similar rates in content analysis studies conducted in Turkey on different subjects (Tatar, 
Kagizmanli, & Akkaya, 2013), there are also studies indicating that quantitative research 
methods are more common than qualitative research methods (Ciltas, Guler, & Sozbilir, 
2012; Goksu, Ozcan, Cakir, & Goktas, 2014; Selcuk, Palanci, Kandemir, & Dundar, 2014). 
Besides literature reviews, quantitative and quantitative methods employed in researches, 
the mixed research method is used and also development works are implemented to build 
a virtual learning environment in this field. 

It is observed scales are the most common data collection tool, and mostly likert-type 
scales are preferred. Similarly, the study of Selcuk and his colleagues (2014) indicates that 
most common data collection tools employed in Turkey are the scales measuring 
perception, attitude, and other variables. On the other hand, some studies shows that the 
data collection tool that is mostly preferred is questionnaires (Ciltas et al., 2012; Goksu et 
al., 2014). In addition, studies on virtual learning environments in Turkey further show that 
interviews, questionnaires, observations and achievement tests are used as data collection 
tools respectively besides scales. 

The results of content analysis also show that the most common sample size is the 31-100 
range including undergraduate students, which is consistent with the findings of another 
content analysis studies (Ciltas et al., 2012; Tatar et al., 2013). It could be argued that the 
selected research method is effective in determining the sample size. It is observed in the 
studies on virtual learning environments in Turkey that some sampling criterion are defined 
prior to the sample selection, and mostly purposive sampling method is used. Furthermore, 
the key reason to select undergraduate students as a sample is that the academicians 
access easier to undergraduate students to conduct their studies. 

In the study, it is seen that the most common studied variable in virtual learning 
environments is usability than academic success, skill development, motivation, presence, 
attitude, efficacy, cognitive load and spatial thinking respectively. The diversity of the 
variables is generally consistent with studies conducted in the field of education. The 
findings of the studies show that activities implemented in virtual learning environments 
have positive influence on the variables examined in the studies. On the other hand, the 
studies on the usability reveal that virtual learning environments may be used in teaching 
and learning processes. 

SUGGESTIONS 

This results of the study seems important to put forward the current situation by examining 
the studies on virtual learning environments conducted in Turkey. The opinion is that the 
findings of this study may guide researchers aiming to employ virtual learning 
environments. The main limitation of the study is that virtual learning environments used 
in the studies show different characteristics. In conclusion, some suggestions may be 
developed for future studies based on the results. 

It is seen that single virtual environment is generally used and its impact on variables is 
examined in the studies. Therefore, two or more virtual environments may be used and 
their effects on variables may be compared. Also, the effects on different variables of virtual 
learning environment may be analyzed. Furthermore, researchers may conduct new studies 
to discover the influence of virtual learning environments on permanent learning. 
Moreover, some scales may be developed to use in the field studies and they may be used 
to obtain more reliable results about the effects of the virtual learning environments on 
several variables. Finally, longitudinal studies may be conducted to explore the long-term 
influences of virtual learning environments on wide samples. 
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APPENDIXES 


A. Distribution of the studies by year 


Source 


Council of Higher Education's National Thesis Database 

Akademik Bilisim Conference _ 

International Computer & Instructional Technologies 
Symposium _ 

Turkish Online Journal of Educational Technology _ 
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